Motion Robust High-Speed Light-Weighted Object Detection With Event Camera

نویسندگان

چکیده

In this work, we propose a motion robust and high-speed detection pipeline which better leverages the event data. First, design an stream representation called temporal active focus (TAF), efficiently utilizes spatial-temporal asynchronous stream, constructing tensors to object motions. Then, module bifurcated folding (BFM), encodes rich information in TAF tensor at input layer of detector. Following this, lightweight detector agile (AED) plus simple but effective data augmentation method, enhance accuracy reduce model's parameter. Experiments on two typical real-scene camera datasets show that our method is competitive terms accuracy, efficiency, number parameters. By classifying objects into multiple levels based optical flow density metric, further illustrated robustness for with different velocities relative camera. The codes trained models are available https://github.com/HarmoniaLeo/FRLW-EvD .

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic Object Detection in Video Sequences with Camera in Motion

Automatic moving object detection/extraction has been explored extensively by the computer vision community. Unfortunately majority of the work has been limited to stationary cameras, in which background subtraction is utilized as the major methodology. In this paper, we will present a technique to tackle the problem in the case of moving camera which is the most often encountered situation in ...

متن کامل

Event-based, 6-DOF Camera Tracking for High-Speed Applications

In contrast to standard cameras, which produce frames at a fixed rate, event cameras respond asynchronously to pixel-level brightness changes, thus enabling the design of new algorithms for high-speed applications with latencies of microseconds. However, this advantage comes at a cost: because the output is composed by a sequence of events, traditional computer-vision algorithms are not applica...

متن کامل

High-Speed Smart Camera with High Resolution

High-speed video cameras are powerful tools for investigating for instance the biomechanics analysis or the movements of mechanical parts in manufacturing processes. In the past years, the use of CMOS sensors instead of CCDs has enabled the development of high-speed video cameras offering digital outputs, readout flexibility, and lower manufacturing costs. In this paper, we propose a high-speed...

متن کامل

Robust Salient Moving Object Detection with Light-Computational Load

In this paper, we propose a method which detects salient moving objects with lightcomputational load. Though Gaussian Mixture Model is widely used for object detection, it is computationally heavy. On the other hand, basic methods like temporal difference are simple and fast but they have constraints as hole or ghost problems. We have combined these algorithms to overcome each one’s weakness. W...

متن کامل

Structural Modal Identification Through High Speed Camera Video: Motion Magnification

Video cameras offer the unique capability of collecting high density spatial data from a distant scene of interest. They could be employed as remote monitoring or inspection sensors because of their commonplace use, simplicity, and relatively low cost. The difficulty is in interpreting the video data into a usable format, such as displacement, that is familiar to engineers. A methodology called...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Instrumentation and Measurement

سال: 2023

ISSN: ['1557-9662', '0018-9456']

DOI: https://doi.org/10.1109/tim.2023.3269780